Observing sources of system resilience using in situ alarm simulations.

Alarm fatigue (and resultant alarm nonresponse) threatens the safety of hospitalized patients. Historically threats to patient safety, including alarm fatigue, have been evaluated using a Safety I perspective analyzing rare events such as failure to respond to patients' critical alarms. Safety II approaches call for learning from the everyday adaptations clinicians make to keep patients safe. To identify such sources of resilience in alarm systems, we conducted 59 in situ simulations of a critical hypoxemic-event alarm in medical/surgical and intensive care units at a tertiary care pediatric hospital between December 2019 and May 2022. Response timing, observations of the environment, and postsimulation debrief interviews were captured. Four primary means of successful alarm responses were mapped to domains of Systems Engineering Initiative for Patient Safety framework to inform alarm system design and improvement.

Integration of the Cleft-Q Patient Reported Outcome Tool into a Multidisciplinary Cleft and Craniofacial Clinic: A Proof of Concept.

SUMMARY: Implementation of patient reported outcome (PRO) tools has increased internationally in a variety of clinical settings, with emerging evidence suggesting benefits for patient satisfaction, improved patient-provider communication, and management of chronic conditions. However, integrating PROs into clinical workflow remains a barrier to implementation, with common challenges including patient completion, provider review of results, and future accessibility of data. Cleft lip and/or palate (CL/P) presents with a variety of aesthetic, functional, and psychosocial sequelae optimally managed by a multidisciplinary team, and Cleft-Q is a validated twelve-module PRO that captures patient perception in these domains. Given the emerging proven benefits of using PROs in a clinical setting, the authors integrated the Cleft-Q PRO at a multidisciplinary cleft and craniofacial clinic at a large, urban, tertiary care center. We collaborated with our institution's EHR Clinical Informatics Team to automatically identify eligible CL/P patients and generate the Cleft-Q PRO prior to weekly multidisciplinary cleft and craniofacial clinic days. Patient results were automatically scored, compared to age-based normative data, and populated into the EHR patient note. Cleft-Q results were viewed by clinicians during patient visits to initiate module-specific discussion in relation to patient age-based normative results. Patient-specific Cleft-Q data were also discussed during multidisciplinary cleft and craniofacial team discussions to aid in clinical decision making. This experience may have applicability to other PRO tools in plastic surgery and other medical specialties where integrating PROs may yield superior patient experience and outcomes.

The Electronic Health Record as a Quality Improvement Tool: Exceptional Potential with Special Considerations.

The electronic health record (EHR) offers an exciting opportunity for quality improvement efforts. An understanding of the nuances of a site's EHR landscape including the best practices in clinical decision support design, basics of data capture, and acknowledgment of the potential unintended consequences of technology change is essential to ensuring effective usage of this powerful tool.

Clinician Perspectives on Specifications for Metrics to Inform Pediatric Alarm Management.

Background: Ongoing management of monitor alarms is important for reducing alarm fatigue among clinicians (e.g., nurses, physicians). Strategies to enhance clinician engagement in active alarm management in pediatric acute care have not been well explored. Access to alarm summary metrics may enhance clinician engagement. Objective: To lay the foundation for intervention development, we sought to identify functional specifications for formulating, packaging, and delivering alarm metrics to clinicians. Methods: Our team of clinician scientists and human factors engineers conducted focus groups with clinicians from medical-surgical inpatient units in a children's hospital. We inductively coded transcripts, developed codes into themes, and grouped themes into "current state" and "future state." Results: We conducted five focus groups with 13 clinicians (eight registered nurses and five doctors of medicine). In the current state, information exchanged among team members about alarm burden is initiated by nurses on an ad hoc basis. For a future state, clinicians identified ways in which alarm metrics could help them manage alarms and described specific information, such as alarm trends, benchmarks, and contextual data, that would support decision-making. Conclusion: We developed four recommendations for future strategies to enhance clinicians' active management of patient alarms: (1) formulate alarm metrics for clinicians by categorizing alarm rates by type and summarizing alarm trends over time, (2) package alarm metrics with contextual patient data to facilitate clinicians' sensemaking, (3) deliver alarm metrics in a forum that facilitates interprofessional discussion, and (4) provide clinician education to establish a shared mental model about alarm fatigue and evidence-based alarm-reduction strategies.

Pediatric Characteristics Associated With Higher Rates of Monitor Alarms.

Background: Continuous physiologic monitoring commonly is used in pediatric medical-surgical (med-surg) units and is associated with high alarm burden for clinicians. Characteristics of pediatric patients generating high rates of alarms on med-surg units are not known. Objective: To describe the demographic and clinical characteristics of pediatric med-surg patients associated with high rates of clinical alarms. Methods: We conducted a cross-sectional, single-site, retrospective study using existing clinical and alarm data from a children's hospital. Continuously monitored patients from med-surg units who had available alarm data were included. Negative binomial regression models were used to test the association between patient characteristics and the rate of clinical alarms per continuously monitored hour. Results: Our final sample consisted of 1,569 patients with a total of 38,501 continuously monitored hours generating 265,432 clinical alarms. Peripheral oxygen saturation (SpO2) low alarms accounted for 57.5% of alarms. Patients with medical complexity averaged 11% fewer alarms per hour than those without medical complexity (P < 0.01). Patients older than 5 years had up to 30% fewer alarms per hour than those who were younger than 5 years (P < 0.01). Patients using supplemental oxygen averaged 39% more alarms per hour compared with patients who had no supplemental oxygen use (P < 0.01). Patients at high risk for deterioration averaged 19% more alarms per hour than patients who were not high risk (P = 0.01). Conclusion: SpO2 alarms were the most common type of alarm in this study. The results highlight patient populations in pediatric medical-surgical units that may be high yield for interventions to reduce alarms. Most physiologic monitor alarms in pediatric medical-surgical (med-surg) units are not informative and likely could be safely eliminated to reduce noise and alarm fatigue.1-3 However, identifying and sustaining successful alarm-reduction strategies is a challenge. Research shows that 25% of patients in pediatric med-surg units produce almost three-quarters of all alarms.4 These patients are a potential high-yield target for alarm-reduction strategies; however, we are not aware of studies describing characteristics of pediatric patients generating high rates of alarms. The patient populations seen on pediatric med-surg units are diverse. Children of all ages are cared for on these units, with diagnoses ranging from acute respiratory infections, to management of chronic conditions, and to psychiatric conditions. Not all patients on pediatric med-surg units have physiologic parameters continuously monitored,4 but among those who do, understanding patient characteristics associated with high rates of alarms may help clinicians, healthcare technology management (HTM) professionals, and others working on alarm management strategies to develop targeted interventions. We conducted an exploratory retrospective study to describe patient characteristics associated with high rates of alarms in pediatric med-surg units.

Using human factors principles to redesign a 3D lab workflow during the COVID-19 pandemic.

BACKGROUND: Like most hospitals, our hospital experienced COVID-19 pandemic-related supply chain shortages. Our additive manufacturing lab's capacity to offset these shortages was soon overwhelmed, leading to a need to improve the efficiency of our existing workflow. We undertook a work system analysis guided by the Systems Engineering Initiative for Patient Safety (SEIPS) construct which is based on human factors and quality improvement principles. Our objective was to understand the inefficiencies in project submission, review, and acceptance decisions, and make systematic improvements to optimize lab operations. METHODS: Contextual inquiry (interviews and workflow analysis) revealed suboptimal characteristics of the system, specifically, reliance on a single person to facilitate work and, at times, fractured communication with project sponsors, with root causes related to the project intake and evaluation process as identified through SEIPS tools. As interventions, the analysis led us to: 1) enhance an existing but underused project submission form, 2) design and implement an internal project scorecard to standardize evaluation of requests, and 3) distribute the responsibility of submission evaluation across lab members. We implemented these interventions in May 2021 for new projects and compare them to our baseline February 1, 2018 through - April 30, 2021 performance (1184 days). RESULTS: All project requests were submitted using the enhanced project submission form and all received a standardized evaluation with the project scorecard. Prior to interventions, we completed 35/79 (44%) of projects, compared to 12/20 (60%) of projects after interventions were implemented. Time to review new submissions was reduced from an average of 58 days to 4 days. A more distributed team responsibility structure permitted improved workflow with no increase in staffing, allowing the Lab Manager to devote more time to engineering rather than administrative/decision tasks. CONCLUSIONS: By optimizing our workflows utilizing a human factors approach, we improved the work system of our additive manufacturing lab to be responsive to the urgent needs of the pandemic. The current workflow provides insights for labs aiming to meet the growing demand for point-of-care manufacturing.

Parental Insights into Improving Home Pulse Oximetry Monitoring in Infants.

Home pulse oximeters prescribed for infants with cardiorespiratory conditions generate many false alarms, which create caregiver stress and sleep disturbance and can lead to unsafe practices. Additionally, relationships among oximeters, alarms, and everyday living demands are not well understood. Therefore, we aimed to gather parent perspectives on home pulse oximetry monitoring during the problem analysis phase of a quality improvement (QI) initiative. Methods: We purposively sampled and interviewed parents of infants prescribed home pulse oximeters and receiving local home care company services. We based questions on systems engineering frameworks previously used in healthcare. Data were coded iteratively and analyzed deductively (theoretical frameworks) and inductively (emerging themes). Results: Generally, themes aligned with theoretical frameworks. Parents expressed dissatisfaction with the number of false alarms home pulse oximeters generate, which parents primarily attributed to poor probe adhesiveness and the inability of oximeters to account for infant movement. Interviews highlighted the burden associated with poor device tones and portability. Device-related issues had negative repercussions for the entire family related to sleep quality, mobility, and social interactions. Universally, parents developed workarounds, including cessation of monitoring. Conclusions: Parents of infants monitored at home using pulse oximetry face many challenges, resulting in compromises in safety. Continuing to instruct parents to comply with prescribed monitoring recommendations may be unrealistic. Instead, we suggest re-engineering the home monitoring system with the needs and goals of children and their families at the center. Our description of adapting qualitative research and systems engineering methods may benefit others developing QI work.

Home pulse oximetry after discharge from a quaternary-care children's hospital: Prescriber patterns and perspectives.

INTRODUCTION: Pulse oximetry monitoring is prescribed to children receiving home oxygen for chronic medical conditions associated with hypoxemia. Although home pediatric pulse oximetry is supported by national organizations, there is a lack of guidelines outlining indications and prescribing parameters. METHODS: A mixed-methods analysis of pediatric home pulse oximetry orders prescribed through the institutional home healthcare provider at a large US children's hospital 6/2018-7/2019 was retrospectively reviewed to determine prescribed alarm parameter limits and recommended interventions. Semi-structured qualitative interviews with pediatric providers managing patients receiving home oxygen and pulse oximetry were conducted to identify opportunities to improve home pulse oximetry prescribing practices. Interviews were analyzed using a modified content analysis approach to identify recurring themes. RESULTS: A total of 368 children received home pulse oximetry orders. Orders were most frequently prescribed on noncardiac medical floors (32%). Attending physicians were the most frequent ordering providers (52%). Frequency of use was prescribed in 96% of orders, however, just 70% were provided with specific instructions for interventions when alarms occurred. Provider role and clinical setting were significantly associated with the presence of a care plan. Provider interviews identified opportunities for improvement with the device, management of alarm parameter limits, and access to home monitor data. DISCUSSION: This study demonstrated significant variability in home pulse oximetry prescribing practices. Provider interviews highlighted the importance of the provider-patient relationship and areas for improvement. There is an opportunity to create standardized guidelines that optimize the use of home monitoring devices for patients, families, and pulmonary providers.

Additive manufacturing (3d printing) in response to a pandemic: Lessons learned at the children's hospital of Philadelphia.

The COVID-19 pandemic produced unprecedented challenges to healthcare and medical device manufacturing (e.g. personal protective device and replacement part shortages). Additive manufacturing, 3D printing, and the maker community were uniquely positioned to respond to these needs by providing in-house design and manufacturing to meet the needs of clinicians and hospitals. This paper reviews the pandemic response of Children's Hospital of Philadelphia CHAMP 3D Lab, a point-ofcare3D printing team that supports clinical and research projects across the hospital network. The CHAMP team responded to a variety of COVID-19 healthcare needs including providing protective eyewear and ventilator components, creating a transport hook, and designing a novel transparent facemask. This case series details our response to these needs, describing challenges experienced and lessons learned in overcoming them so that others may learn from our experiences. Challenges to responding to the pandemic included the need to handle urgent pandemic related requests in addition to our standard fare. This required us to not only expand our capacity without additional resources, but also to develop a system of prioritization. Specific changes made included: streamlining workflows, identifying safety review processes, and developing/enlisting a network of collaborators. Further, we consider how to transition to a future, post-pandemic world without losing the cohesive drive of emergency-induced innovation. This paper aims to share what we have learned and to encourage both teams currently engaged in the printing community and those looking to join it.

EHR-Integrated Monitor Data to Measure Pulse Oximetry Use in Bronchiolitis.

BACKGROUND AND OBJECTIVES: Continuous pulse oximetry (oxygen saturation [Spo2]) monitoring in hospitalized children with bronchiolitis not requiring supplemental oxygen is discouraged by national guidelines, but determining monitoring status accurately requires in-person observation. Our objective was to determine if electronic health record (EHR) data can accurately estimate the extent of actual Spo2 monitoring use in bronchiolitis. METHODS: This repeated cross-sectional study included infants aged 8 weeks through 23 months hospitalized with bronchiolitis. In the validation phase at 3 children's hospitals, we calculated the test characteristics of the Spo2 monitor data streamed into the EHR each minute when monitoring was active compared with in-person observation of Spo2 monitoring use. In the application phase at 1 children's hospital, we identified periods when supplemental oxygen was administered using EHR flowsheet documentation and calculated the duration of Spo2 monitoring that occurred in the absence of supplemental oxygen. RESULTS: Among 668 infants at 3 hospitals (validation phase), EHR-integrated Spo2 data from the same minute as in-person observation had a sensitivity of 90%, specificity of 98%, positive predictive value of 88%, and negative predictive value of 98% for actual Spo2 monitoring use. Using EHR-integrated data in a sample of 317 infants at 1 hospital (application phase), infants were monitored in the absence of oxygen supplementation for a median 4.1 hours (interquartile range 1.4-9.4 hours). Those who received supplemental oxygen experienced a median 5.6 hours (interquartile range 3.0-10.6 hours) of monitoring after oxygen was stopped. CONCLUSIONS: EHR-integrated monitor data are a valid measure of actual Spo2 monitoring use that may help hospitals more efficiently identify opportunities to deimplement guideline-inconsistent use.

Physiologic Monitor Alarm Burden and Nurses' Subjective Workload in a Children's Hospital.

BACKGROUND AND OBJECTIVES: Physiologic monitor alarms occur at high rates in children's hospitals; ≤1% are actionable. The burden of alarms has implications for patient safety and is challenging to measure directly. Nurse workload, measured by using a version of the National Aeronautics and Space Administration Task Load Index (NASA-TLX) validated among nurses, is a useful indicator of work burden that has been associated with patient outcomes. A recent study revealed that 5-point increases in the NASA-TLX score were associated with a 22% increased risk in missed nursing care. Our objective was to measure the relationship between alarm count and nurse workload by using the NASA-TLX. METHODS: We conducted a repeated cross-sectional study of pediatric nurses in a tertiary care children's hospital to measure the association between NASA-TLX workload evaluations (using the nurse-validated scale) and alarm count in the 2 hours preceding NASA-TLX administration. Using a multivariable mixed-effects regression accounting for nurse-level clustering, we modeled the adjusted association of alarm count with workload. RESULTS: The NASA-TLX score was assessed in 26 nurses during 394 nursing shifts over a 2-month period. In adjusted regression models, experiencing >40 alarms in the preceding 2 hours was associated with a 5.5 point increase (95% confidence interval 5.2 to 5.7; P < .001) in subjective workload. CONCLUSION: Alarm count in the preceding 2 hours is associated with a significant increase in subjective nurse workload that exceeds the threshold associated with increased risk of missed nursing care and potential patient harm.

Human-centered development of an electronic health record-embedded, interactive information visualization in the emergency department using fast healthcare interoperability resources.

OBJECTIVE: Develop and evaluate an interactive information visualization embedded within the electronic health record (EHR) by following human-centered design (HCD) processes and leveraging modern health information exchange standards. MATERIALS AND METHODS: We applied an HCD process to develop a Fast Healthcare Interoperability Resources (FHIR) application that displays a patient's asthma history to clinicians in a pediatric emergency department. We performed a preimplementation comparative system evaluation to measure time on task, number of screens, information retrieval accuracy, cognitive load, user satisfaction, and perceived utility and usefulness. Application usage and system functionality were assessed using application logs and a postimplementation survey of end users. RESULTS: Usability testing of the Asthma Timeline Application demonstrated a statistically significant reduction in time on task (P < .001), number of screens (P < .001), and cognitive load (P < .001) for clinicians when compared to base EHR functionality. Postimplementation evaluation demonstrated reliable functionality and high user satisfaction. DISCUSSION: Following HCD processes to develop an application in the context of clinical operations/quality improvement is feasible. Our work also highlights the potential benefits and challenges associated with using internationally recognized data exchange standards as currently implemented. CONCLUSION: Compared to standard EHR functionality, our visualization increased clinician efficiency when reviewing the charts of pediatric asthma patients. Application development efforts in an operational context should leverage existing health information exchange standards, such as FHIR, and evidence-based mixed methods approaches.

Towards a Maturity Model for Clinical Decision Support Operations.

Clinical decision support (CDS) systems delivered through the electronic health record are an important element of quality and safety initiatives within a health care system. However, managing a large CDS knowledge base can be an overwhelming task for informatics teams. Additionally, it can be difficult for these informatics teams to communicate their goals with external operational stakeholders and define concrete steps for improvement. We aimed to develop a maturity model that describes a roadmap toward organizational functions and processes that help health care systems use CDS more effectively to drive better outcomes. We developed a maturity model for CDS operations through discussions with health care leaders at 80 organizations, iterative model development by four clinical informaticists, and subsequent review with 19 health care organizations. We ceased iterations when feedback from three organizations did not result in any changes to the model. The proposed CDS maturity model includes three main "pillars": "Content Creation," "Analytics and Reporting," and "Governance and Management." Each pillar contains five levels-advancing along each pillar provides CDS teams a deeper understanding of the processes CDS systems are intended to improve. A "roof" represents the CDS functions that become attainable after advancing along each of the pillars. Organizations are not required to advance in order and can develop in one pillar separately from another. However, we hypothesize that optimal deployment of preceding levels and advancing in tandem along the pillars increase the value of organizational investment in higher levels of CDS maturity. In addition to describing the maturity model and its development, we also provide three case studies of health care organizations using the model for self-assessment and determine next steps in CDS development.

Hidden health IT hazards: a qualitative analysis of clinically meaningful documentation discrepancies at transfer out of the pediatric intensive care unit.

OBJECTIVE: The risk of medical errors increases upon transfer out of the intensive care unit (ICU). Discrepancies in the documented care plan between notes at the time of transfer may contribute to communication errors. We sought to determine the frequency of clinically meaningful discrepancies in the documented care plan for patients transferred from the pediatric ICU to the medical wards and identified risk factors. MATERIALS AND METHODS: Two physician reviewers independently compared the transfer note and handoff document of 50 randomly selected transfers. Clinically meaningful discrepancies in the care plan between these two documents were identified using a coding procedure adapted from healthcare failure mode and effects analysis. We assessed the influence of risk factors via multivariable regression. RESULTS: We identified 34 clinically meaningful discrepancies in 50 patient transfers. Fourteen transfers (28%) had ≥1 discrepancy, and ≥2 were present in 7 transfers (14%). The most common discrepancy categories were differences in situational awareness notifications and documented current therapy. Transfers with handoff document length in the top quartile had 10.6 (95% CI: 1.2-90.2) times more predicted discrepancies than transfers with handoff length in the bottom quartile. Patients receiving more medications in the 24 hours prior to transfer had higher discrepancy counts, with each additional medication increasing the predicted number of discrepancies by 17% (95% CI: 6%-29%). CONCLUSION: Clinically meaningful discrepancies in the documented care plan pose legitimate safety concerns and are common at the time of transfer out of the ICU among complex patients.

Is desynchrony tolerance adaptable in the perceptual organization of speech?

Speech signal components that are desynchronized from the veridical temporal pattern lose intelligibility. In contrast, audiovisual presentations with large desynchrony in visible and audible speech streams are perceived without loss of integration. Under such conditions, the limit of desynchrony that permits audiovisual integration is also adaptable. A new project directly investigated the potential for adaptation to consistent desynchrony with unimodal auditory sine-wave speech. Listeners transcribed sentences that are highly intelligible, with veridical temporal properties. Desynchronized variants were created by leading or lagging the tone analog of the second formant relative to the rest of the tones composing the sentences, in 50-msec steps, ranging from 250-msec lead to 250-msec lag. In blocked trials, listeners only tolerated desynchronies <50 msec, and exhibited no gain in intelligibility to consistent desynchrony. Unimodal auditory and bimodal audiovisual forms of perceptual integration evidently exhibit different temporal characteristics, an indication of distinct perceptual functions.

Asynchrony tolerance in the perceptual organization of speech.

Researchers have claimed that listeners tolerate large temporal distortion when integrating the spectral components of speech. In some estimates, perceivers resolve linguistic attributes at spectral desynchronies as great as the duration of a syllable. We obtained new measures of perceptual tolerance of auditory asynchrony, using sine-wave synthesis in order to require perceivers to resolve the speech stream dynamically. Listeners transcribed sentences in which the tone analogue of a second formant was desynchronized relative to the remaining tones of a sentence, with desynchrony ranging from a 250-msec lead to a 250-msec lag. Intelligibility declined symmetrically from 72% at synchrony to 7% at +/-100 msec. This finding of narrow asynchrony tolerance indicates a time-critical feature of the auditory perceptual organization of speech.